Adaptive ink prediction

ABSTRACT

A facility for adapting the prediction of ink is described. In some examples, the facility receives information about a spatial movement by a user. On the basis of the received information, the facility predicts future spatial movement by the user, and generates an ink stroke that reflects both the spatial movement described by the received information and at least a portion of the predicted future spatial movement. The facility enforces against the generated ink stroke a limit that has the effect of controlling the area of a portion of the ink stroke corresponding to the at least a portion of the predicted future spatial movement, and causes the generated ink stroke, subject to the enforcement of the limit, to be displayed.

CROSS REFERENCE TO RELATED APPLICATION

This application is a continuation application and, pursuant to 35U.S.C. § 120, is entitled to and claims the benefit of earlier filedapplication U.S. application Ser. No. 16/297,399 filed Mar. 8, 2019claims the benefit of U.S. application Ser. No. 15/051,582 filed Feb.23, 2016, now U.S. Pat. No. 10,338,807, the content of both of which areincorporated herein by reference in their entireties for all purposes.

BACKGROUND

Many processor-based devices support electronic ink: a user inputtechnique where the user handwrites, draws, or performs other arbitraryspatial movements. As a result of such user input, visual marks called“ink” are added to the display that generally correspond to the path ofthe movement. For example, in the case of handwriting, handwritten wordsappear on the display in the same handwriting style that they wereexecuted by the user.

In some cases, the user performs this input by moving a stylus (or“pen”) or his or her finger (collectively, “the writing object”) acrossthe surface of a touchscreen display device, generating a sequence of2-dimensional contact points each having a timestamp identifying thetime at which the contact point was touched. In some cases, the userperforms the inking input by moving a displayed position pointer on thescreen, using an input device such as a mouse or touchpad. Thisinformation is sometimes referred to as “ink input.” The devicetransforms this ink input into ink that is displayed by generating asequence of “ink strokes”—straight or curved segments of ink interpretedfrom the ink input, such as by interpolating and/or smoothing thecontact points of the ink input.

Even in devices having powerful processors, high-speed data buses, etc.,the process of generating and displaying ink takes a certain amount oftime, sometimes referred to as “latency.” In many cases, this latency islarge enough that the generated and displayed ink strokes lag aperceptible distance behind the tip of the writing object as it moves,preventing the user from forming and maintaining the sense that he orshe is directing ink onto the drawing surface by his or her movement ofthe writing object.

In order to overcome the potential negative effects of inking latency,in some cases, the device uses techniques such as extrapolation and/orcurve-fitting to predict one or more future contact points, andgenerates and displays ink using those predicted contact points alongwith the actual ink input, seeking to extend the ink to a point nearerthe tip of the writing object.

In some cases, ink input also contains information about various otherkinds of attributes, such as an indication of force or pressure—whichcan be used by the device in order to determine the thickness of the inkstrokes it generates—and pen angle—which can affect the thickness and/oropacity level of ink strokes. In some cases, the prediction performed bythe device extends to one or more of these additional attributes.

SUMMARY

This summary is provided to introduce a selection of concepts in asimplified form that are further described below in the DetailedDescription. This summary is not intended to identify key factors oressential features of the claimed subject matter, nor is it intended tobe used to limit the scope of the claimed subject matter.

A facility for adapting the prediction of ink is described. In someexamples, the facility receives information about a spatial movement bya user. On the basis of the received information, the facility predictsfuture spatial movement by the user, and generates an ink stroke thatreflects both the spatial movement described by the received informationand at least a portion of the predicted future spatial movement. Thefacility enforces against the generated ink stroke a limit that has theeffect of controlling the area of a portion of the ink strokecorresponding to the at least a portion of the predicted future spatialmovement, and causes the generated ink stroke, subject to theenforcement of the limit, to be displayed.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram showing some of the components that may beincorporated in at least some of the computer systems and other deviceson which the facility operates.

FIG. 2 is a flow diagram showing a first process performed by thefacility in some examples to limit the thickness of predicted ink.

FIG. 3 is a display diagram showing ink displayed by the facility basedupon received actual and predicted future contact points in accordancewith the process shown in FIG. 2.

FIG. 4 is a flow diagram showing a process performed by the facility insome examples to limit the thickness of predicted ink.

FIG. 5 is a display diagram showing ink displayed by the facility basedupon received actual and predicted future contact points in accordancewith the process shown in FIG. 4.

FIG. 6 is a flow diagram showing a process performed by the facility insome examples to control the extent of ink prediction based upon inkthickness.

FIGS. 7 and 8 are display diagrams showing ink displayed by the facilitybased upon received actual and predicted future contact points inaccordance with the process shown in FIG. 6.

FIG. 9 is a flow diagram showing a process performed by the facility insome examples to opt not to display predicted ink where it diverges fromactual ink at too great an angle.

FIGS. 10 and 11 are display diagrams showing ink displayed by thefacility in accordance with the process shown in FIG. 9.

FIG. 12 is a flow diagram showing a first process performed by thefacility in some examples to improve noisy timestamp and/or velocitydata.

FIG. 13 is a table diagram showing contents of a sample improvedtimestamp table reflecting the improvement of noisy timestamps inaccordance with the process shown in FIG. 12.

FIG. 14 is a table diagram showing contents of a sample improvedvelocity table reflecting the improvement of noisy velocities inaccordance with the process shown in FIG. 12.

DETAILED DESCRIPTION

The inventors have identified cases in which conventional ink predictioncauses undesirable results. These include predicting that the writingobject will turn in the wrong direction; predicting that the writingobject will be further ahead than it actually is; predicting that theink will be too thick; displaying erroneous predicted ink when the inkis so thick as to make the error particularly conspicuous; and makingerroneous predictions based upon noisy ink input, such as ink input inwhich timestamps and/or velocity experience systemic or random error.

Accordingly, the inventors have conceived and reduced to practice asoftware and/or hardware facility (“the facility”) for adapting theprediction of ink in ways that reduce the undesirable results ofconventional ink prediction.

In some examples, the facility limits the thickness of predicting ink,such as by capping the thickness of predicted ink at a maximumprediction thickness boundary, or by discarding any predicted contactpoints for which a thickness exceeding a maximum prediction thicknessboundary is predicted and those predicted for later times. In someexamples, the facility performs a similar kind of bounding with respectto a minimum prediction thickness boundary, including, in some cases,ending prediction when actual or predicted ink thickness reaches theminimum prediction thickness boundary.

In some examples, the facility establishes an inverse relationshipbetween the thickness and extent of prediction—that is, as the thicknessof ink currently being displayed by the facility increases, the amountof time or distance for which the facility displays predicted inkdecreases

In some examples, in order to determine whether to display predictedink, the facility compares the instantaneous direction at the latest endof the predicted ink to the instantaneous direction at the latest end ofthe ink based upon actual contact points. If the direction at the latestend of the predicted ink diverges from the direction at the latest endof the ink based upon actual contact points by more than a thresholdangle, the facility omits to display the predicted ink.

In some examples, the facility handles noisy timestamp and/or velocitydata, such as by subjecting it to sliding-window averaging.

In some examples, the facility's adaptation of ink prediction isperformed with respect to “wet” ink displayed before the user lifts thepen or other writing object from the writing surface, and does notaffect “dry” ink that is displayed and recorded when the writing objectis lifted from the writing surface. This dry ink is generated basedsolely on actual contact points, without the use of any ink prediction.

By performing in some or all of the ways described above, the facilityimproves the inking experience of users for whom ink prediction is beingperformed. In various examples, the facility further improves theefficiency with which inking processes consume hardware resources—suchas processor cycles and space in short-term and long-term memory, onbuses, etc.—enabling such hardware resources to be used for additionalpurposes, or less powerful hardware resources to be substituted.

FIG. 1 is a block diagram showing some of the components that may beincorporated in at least some of the computer systems and other deviceson which the facility operates. In various examples, these computersystems and other devices 100 can include server computer systems,desktop computer systems, laptop computer systems, tablet computersystems, netbooks, mobile phones, personal digital assistants,televisions, cameras, automobile computers, electronic media players,electronic kiosk devices, electronic table devices, electronicwhiteboard devices, etc. In various examples, the computer systems anddevices may include any number of the following: a central processingunit (“CPU”) 101 for executing computer programs; a computer memory 102for storing programs and data while they are being used, including thefacility and associated data, an operating system including a kernel anddevice drivers, and one or more applications; a persistent storagedevice 103, such as a hard drive or flash drive for persistently storingprograms and data; a computer-readable media drive 104, such as afloppy, CD-ROM, or DVD drive, for reading programs and data stored on acomputer-readable medium; and/or a communications subsystem 105 forconnecting the computer system to other computer systems and/or otherdevices to send and/or receive data, such as via the Internet or anotherwired or wireless network and its networking hardware, such as switches,routers, repeaters, electrical cables and optical fibers, light emittersand receivers, radio transmitters and receivers, and the like.

In various examples, these computer systems and other devices 100 mayfurther include any number of the following: a display 106 forpresenting visual information, such as text, images, icons, documents,menus, etc.; and a touchscreen digitizer 107 for sensing interactionswith the display, such as touching the display with one or more fingers,styluses, or other objects. In various examples, the touchscreendigitizer uses one or more available techniques for sensing interactionswith the display, such as resistive sensing, surface acoustic wavesensing, surface capacitance sensing, projected capacitance sensing,infrared grid sensing, infrared acrylic projection sensing, opticalimaging sensing, dispersive signal sensing, and acoustic pulserecognition sensing. In various examples, the computer systems and otherdevices 100 include input devices of various other types, such askeyboards, mice, styluses, etc. (not shown).

While computer systems or other devices configured as described abovemay be used to support the operation of the facility, those skilled inthe art will appreciate that the facility may be implemented usingdevices of various types and configurations, and having variouscomponents.

FIG. 2 is a flow diagram showing a first process performed by thefacility in some examples to limit the thickness of predicted ink. At201, the facility receives an actual contact point from the inputdevice. The received actual contact point includes at least touchlocation and pressure (or a correlated measure, such as force;hereafter, such measures are referred to interchangeably). At 202, thefacility uses the pressure of the actual contact point received at 201to determine an ink thickness for the contact point. In general, thehigher the pressure, the larger the ink thickness. At 203, if thefacility has received actual contact points that are adequate to predictfuture contact points, then the facility continues at 206, else thefacility continues at 204. In various examples, the facility makes thedetermination of act 203 by, for example, comparing the number of actualcontact points to a predetermined minimum number; attempting to fit acurve or otherwise project future contact points and determining whetherthe result has an adequate level of certainty, etc. At 204, the facilitygenerates an ink stroke using received actual contact points, to theexclusion of any predicted future contact points. At 205, the facilitydisplays the ink stroke generated at 204. After act 205, the facilitycontinues at 201 to receive the next contact point.

At 206, where adequate actual contact points have been received topredict future contact points, the facility predicts one or more futurecontact points based on actual contact points received at 202. Thefuture contact points predicted at 206 each include at least locationand ink thickness. At 207, if any thickness predicted for future contactpoints at 206 exceeds a thickness prediction boundary, then the facilitycontinues at 208, else the facility continues at 209. At 208, thefacility bounds the thicknesses predicted at 206 at the thicknessprediction boundary—that is, for each predicted thickness that exceedsthe thickness prediction boundary, the facility reduces the predictedthickness to the thickness prediction boundary. At 209, the facilitygenerates an ink stroke using received actual contact points pluspredicted future contact points using the thicknesses determined foractual contact points at 202 and the thicknesses predicted for futurecontact points at 206, subject to any adjustments performed at 208.After act 209, the facility continues at 205 to display the ink strokegenerated at 209.

Those skilled in the art will appreciate that the steps shown in FIG. 2and in each of the flow diagrams discussed below may be altered in avariety of ways. For example, the order of the steps may be rearranged;some steps may be performed in parallel; shown steps may be omitted, orother steps may be included; a shown step may be divided into substeps,or multiple shown steps may be combined into a single step, etc.

FIG. 3 is a display diagram showing ink displayed by the facility basedupon received actual and predicted future contact points in accordancewith the process shown in FIG. 2. The display 300 shows actual contactpoints 301-304, each shown as an “X”. In particular, the size of each“X” indicates the relative level of pressure received for thecorresponding actual contact point. It can be seen that, moving fromactual contact point 301 to actual contact point 304, the level ofpressure steadily increases. The display further shows predicted futurecontact points 331-333, each shown as a “□”. Similarly, the size of each“□” indicates an ink thickness predicted for the corresponding predictedfuture contact point. It can be seen that, moving from predicted futurecontact point 331 to predicted future contact point 333, the pressurelevel predicted for these contact points continues to increase beyondthe pressure level of the most recent actual contact point 304. Byexamining the thickness of the ink stroke made up of stroke segments341-347, it can be seen that, moving from stroke segment 341 to strokesegment 345, the ink thickness steadily increases in accordance with theincreasing pressure among the actual and predicted contact points. Insome examples, the ink thickness varies more smoothly through the lengthof a stroke than shown in FIG. 3. In stroke segment 345, however, theink thickness reaches the thickness prediction boundary. Accordingly,the ink thickness in stroke segments 346 and 347 is limited to the samevalue as in stroke segment 345 at at, despite the pressure levels ofpredicted future contact points 332 and 333, which continue to increase.

FIG. 4 is a flow diagram showing a process performed by the facility insome examples to limit the thickness of predicted ink. At 401, thefacility receives an actual contact point from the input device. Thereceived actual contact point includes at least touch location andpressure. At 402, the facility uses the pressure of the actual contactpoint received at 401 to determine an ink thickness for the contactpoint. In general, the higher the pressure, the larger the inkthickness. At 403, if the facility has received actual contact pointsthat are adequate to predict future contact points, then the facilitycontinues at 406, else the facility continues at 404. At 404, thefacility generates an ink stroke using received actual contact points,to the exclusion of any predicted future contact points. At 405, thefacility displays the ink stroke generated at 404. After act 405, thefacility continues at 401 to receive the next contact point.

At 406, where adequate actual contact points have been received topredict future contact points, the facility predicts one or more futurecontact points based on actual contact points received at 402. Thefuture contact points predicted at 406 each include at least locationand ink thickness. At 407, if any thickness predicted for future contactpoints at 406 exceeds a thickness prediction boundary, then the facilitycontinues at 408, else the facility continues at 409. At 408, thefacility generates an ink stroke predicted future contact points usingthe thicknesses determined for actual contact points at 402 and thethicknesses predicted for future contact points at 406. After 408, thefacility continues at 405 to display the ink stroke generated at 408. At409, the facility generates an ink stroke using received actual contactpoints, plus only those predicted future contact points that precede intime the earliest predicted future contact point whose predictedthickness exceeds a thickness prediction boundary. After 409, thefacility continues at 405 to display the ink stroke generated at 409.

FIG. 5 is a display diagram showing ink displayed by the facility basedupon received actual and predicted future contact points in accordancewith the process shown in FIG. 4. The display 500 represents the sameinput as the display shown in FIG. 3, and shows actual contact points501-504, as well as predicted future contact point 331. It can be seenthat, in generating the stroke made up of stroke segments 541-545, thefacility has ignored later predicted future contact points 332 and 333shown in FIG. 3, as the thickness predicted for future contact point 332exceeds the thickness prediction boundary.

FIG. 6 is a flow diagram showing a process performed by the facility insome examples to control the extent of ink prediction based upon inkthickness. At 601, the facility receives an actual contact point fromthe input device. The received actual contact point includes at leasttouch location and pressure. At 602, the facility uses the pressure ofthe actual contact point received at 601 to determine an ink thicknessfor the contact point. At 603, if the facility has received actualcontact points that are adequate to predict future contact points, thenthe facility continues at 606, else the facility continues at 604. At604, the facility generates an ink stroke using received actual contactpoints, to the exclusion of any predicted future contact points. At 605,the facility displays the ink stroke generated at 604. After act 605,the facility continues at 601 to receive the next contact point.

At 606, where adequate actual contact points have been received topredict future contact points, the facility determines a number offuture contact points to predict that is inversely related to thethickness determined for the most recent actual contact point. In someexamples, for instance, the facility establishes a first range ofpossible ink thicknesses, and a second range of possible numbers offuture contact points to predict, distances to predict ink, etc.; thefacility selects a point in the second range that is the same percentageof the size of the second range away from the top of the second range asthe actual ink width is from the bottom of the first range. In variousexamples, at 606, the facility determines an extent to which to predictink in accordance with a variety of measures, including number ofcontact points, distance, amount of time at average or sample velocity,etc. At 607, the facility predicts one or more future contact pointsbased on actual contact points received at 602, to an extent determinedby the facility at 606. At 608, the facility generates an ink strokeusing received actual contact points plus predicted future touch. Afteract 608, the facility continues at 605 to display the ink strokegenerated at 608.

FIGS. 7 and 8 are display diagrams showing ink displayed by the facilitybased upon received actual and predicted future contact points inaccordance with the process shown in FIG. 6. In particular, FIG. 8 showsink produced by the facility at a higher thickness.

In FIG. 7, the display 700 shows actual contact points 701-704, as wellas three predicted future contact points 731-733. It can be seen thatthe ink 740 generated by the facility has a relatively low thickness,and extends through all three predicted future contact points.

In FIG. 8, the display 800 shows actual contact points 801-804, as wellas a single predicted future contact point 831. It can be seen that, inresponse to a higher pressure than was used in FIG. 7, the ink 840generated by the facility has a higher thickness than the ink shown inFIG. 7, and extends only through one predicted future contact point.

FIG. 9 is a flow diagram showing a process performed by the facility insome examples to opt not to display predicted ink where it diverges fromactual ink at too great an angle. At 901, the facility receives anactual contact point from the input device. The received actual contactpoint includes at least touch location. At 902, the facility generates afirst ink stroke using only actual contact points received at 901, tothe exclusion of any predicted future contact points. At 903, if thefacility has received actual contact points that are adequate to predictfuture contact points, then the facility continues at 905, else thefacility continues at 904. At 904, the facility displays the first inkstroke generated at 902 solely on the basis of actual contact points.After act 904, the facility continues at 901 to receive the next contactpoint.

At 905, where adequate actual contact points have been received topredict future contact points, the facility predicts one or more futurecontact points based on actual contact points received at 901. Thefuture contact points predicted at 905 each include at least location.At 906, the facility generates a second ink stroke using received actualcontact points plus predicted future contact points. At 907, for each ofthe first and second ink stroke, the facility determines a tangentfactor at the latest end of the ink stroke that indicates theinstantaneous direction at the latest end of the ink stroke. At 908, ifthe angle between the 2 tangent factors determined at 907 exceeds athreshold angle, such as a threshold angle of 35°, then the facilitycontinues at 904 to display the first stroke generated solely on thebasis of actual contact points, else the facility continues at 909. At909, the facility displays the second stroke generated on the basis ofboth actual contact points and predicted future contact points. Afteract 909, the facility continues at 901 to receive the next contactpoint.

FIGS. 10 and 11 are display diagrams showing ink displayed by thefacility in accordance with the process shown in FIG. 9. In particular,FIG. 10 shows a situation in which the facility opts against displayingpredicted ink, in contrast to FIG. 11 which shows a situation in whichthe facility does display predicted ink.

In FIG. 10, the display 1000 shows actual contact points 1001-1013, andpredicted future contact points 1031-1033. Also shown are first stroke1020 generated by the facility based only on the actual contact points,and a second stroke 1020+1040 generated by the facility based on boththe actual contact points and the predicted future contact points. Inorder to determine whether to display the first stroke or the secondstroke, the facility determines tangent 1021 at the latest end of thefirst stroke, and tangent 1041 at the latest end of the second stroke.These two tangents form angle 1050 which, at 85°, exceeds the facility'sthreshold angle of 35°. Accordingly, the facility displays the firststroke 1020 which omits predicted ink 1040, rather than the secondstroke 1020+1040 that includes predicted ink 1040.

In FIG. 11, the display 1100 shows actual contact points 1101-1108, andpredicted future contact points 1131-1132. Also shown are first stroke1120 generated by the facility based only on the actual contact points,and a second stroke 1120+1140 generated by the facility based on boththe actual contact points and the predicted future contact points. Inorder to determine whether to display the first stroke or the secondstroke, the facility determines tangent 1121 at the latest end of thefirst stroke, and tangent 1141 at the latest end of the second stroke.These two tangents form angle 1150 which, at 25°, does not exceed thefacility's threshold angle of 35°. Accordingly, the facility displaysthe second stroke 1020, which includes predicted ink 1140.

FIG. 12 is a flow diagram showing a first process performed by thefacility in some examples to improve noisy timestamp and/or velocitydata. At 1201, the facility receives an actual contact point from theinput device. The received actual contact point includes at least touchlocation and timestamp. At 1202, the facility adjusts the timestamp ofthe actual contact point received at 1201 by subjecting it to a slidingwindow average, such as one that uses a window size of the interval sizebetween the last 6 pairs of timestamps. In some examples, rather thanadjusting each contact point's timestamp, the facility adjusts avelocity at each contact point. At 1203, if the facility has receivedactual contact points that are adequate to predict future contactpoints, then the facility continues at 1206, else the facility continuesat 1204. At 1204, the facility generates an ink stroke using only actualcontact points received at 1201 with their adjusted timestamps orvelocities, to the exclusion of any predicted future contact points. At1205, the facility displays the first ink stroke generated at 1204solely on the basis of actual contact points. After act 1205, thefacility continues at 1201 to receive the next contact point.

At 1206, where adequate actual contact points have been received topredict future contact points, the facility predicts one or more futurecontact points based on actual contact points received at 1201 withtheir adjusted timestamps or velocities. The future contact pointspredicted at 905 each include at least location and timestamp. At 1207,the facility generates an ink stroke using received actual contactpoints plus predicted future contact points. After act 1207, thefacility continues at 1205 to display the ink stroke generated at 1207.

FIG. 13 is a table diagram showing contents of a sample improvedtimestamp table reflecting the improvement of noisy timestamps inaccordance with the process shown in FIG. 12. The improved timestamptable 1300 is made up of rows 1301-1312, each corresponding to adifferent contact point. Each row is divided into the following columns:a timestamp column 1351 containing the timestamp received as part of thecontact point to which the row corresponds; an x position column 1352containing the horizontal coordinate of the contact point position,expressed in units such as physical pixels, logical pixels, distance,etc.; a y position column 1353 containing the vertical coordinate of thecontact point position; a time elapsed column 1354 containing an elapsedtime calculated between the timestamp of the current contact point inthe timestamp of the immediately-preceding contact point; an averageelapsed time column 1355 containing an average of the elapsed times ofthe current contact point and the five immediately-preceding contactpoints; and an improved timestamp column 1356 containing an improvedtimestamp for the contact point calculated by adding the average elapsedtime for the current contact point to the timestamp or improvedtimestamp for the immediately preceding contact point. For example, row1307 indicates that the corresponding contact point was received withthe timestamp “09:07:05.0502”, and the position (140, 41); that anelapsed time between this timestamp and the timestamp of the immediatelypreceding contact point is 0.0027 seconds; that the six-sample averageelapsed time is 0.0067 seconds; and that the improved timestamp for thiscontact point is “09:07:05.0542”.

While FIG. 13 and each of the table diagrams discussed below show atable whose contents and organization are designed to make them morecomprehensible by a human reader, those skilled in the art willappreciate that actual data structures used by the facility to storethis information may differ from the table shown, in that they, forexample, may be organized in a different manner; may contain more orless information than shown; may be compressed and/or encrypted; maycontain a much larger number of rows than shown, etc.

FIG. 14 is a table diagram showing contents of a sample improvedvelocity table reflecting the improvement of noisy velocities inaccordance with the process shown in FIG. 12. The improved velocitytable 1400 is made up of rows 1401-1412, each corresponding to adifferent contact point. Each row is divided into the following columns:a timestamp column 1451 containing the timestamp received as part of thecontact point to which the row corresponds; an x position column 1452containing the horizontal coordinate of the contact point position,expressed in units such as physical pixels, logical pixels, distance,etc.; a y position column 1453 containing the vertical coordinate of thecontact point position; a time elapsed column 1454 containing an elapsedtime calculated between the timestamp of the current contact point inthe timestamp of the immediately-preceding contact point; a distancetraveled column 1455 containing a distance traveled calculated from thetwo-dimensional position of the immediately preceding contact point tothe two-dimensional position of the current contact point; a velocitycolumn 1456 containing a velocity calculated by dividing the distancetraveled by the time elapsed; an average velocity column 1457 containingan average of the velocities of the current contact point and the fiveimmediately-preceding contact points; and an improved velocity column1458 containing an improved velocity for the contact point determined bycopying the average velocity. For example, row 1407 indicates that thecorresponding contact point was received with the timestamp“09:07:05.0502”, and the position (140, 41); that an elapsed timebetween this timestamp and the timestamp of the immediately precedingcontact point is 0.0027 seconds; that the distance traveled from theprevious contact point to this contact point is 16.76 pixels; that thisreflects a velocity of 6209 pixels per second; that the six-sampleaverage velocity is 4337; and that the improved velocity is 4337.

In some examples, the facility provides a processor-based device,comprising: a processor; a touchscreen; and a memory having contentsthat cause the processor to: receive a sequence of touch pointsgenerated using the touchscreen; determine a first ink stroke based uponthe received sequence of touch points, the first ink stroke having alater end corresponding to the last touch point in the receivedsequence; on the basis of the received sequence of touch points, predicta sequence of one or more future touch points; determine a second inkstroke based upon the received sequence of touch points plus the one ormore predicted future touch points, the second ink stroke having a laterend corresponding to the last future touch point in the predictedsequence; determine a first instantaneous direction of the first inkstroke at its later end; determine a second instantaneous direction ofthe second ink stroke at its later end; determine an angle between thefirst and second directions; where the determined angle exceeds athreshold angle, display the first ink stroke; and where the determinedangle does not exceed the threshold angle, display the second inkstroke.

In some examples, the facility provides a computer-readable mediumhaving contents configured to cause a computing system to: receive asequence of touch points generated using the touchscreen; determine afirst ink stroke based upon the received sequence of touch points, thefirst ink stroke having a later end corresponding to the last touchpoint in the received sequence; on the basis of the received sequence oftouch points, predict a sequence of one or more future touch points;determine a second ink stroke based upon the received sequence of touchpoints plus the one or more predicted future touch points, the secondink stroke having a later end corresponding to the last future touchpoint in the predicted sequence; determine a first instantaneousdirection of the first ink stroke at its later end; determine a secondinstantaneous direction of the second ink stroke at its later end;determine an angle between the first and second directions; where thedetermined angle exceeds a threshold angle, display the first inkstroke; and where the determined angle does not exceed the thresholdangle, display the second ink stroke.

In some examples, the facility provides a method in a computing system,the method comprising: receiving a sequence of touch points generatedusing the touchscreen; determining a first ink stroke based upon thereceived sequence of touch points, the first ink stroke having a laterend corresponding to the last touch point in the received sequence; onthe basis of the received sequence of touch points, predicting asequence of one or more future touch points; determine a second inkstroke based upon the received sequence of touch points plus the one ormore predicted future touch points, the second ink stroke having a laterend corresponding to the last future touch point in the predictedsequence; determining a first instantaneous direction of the first inkstroke at its later end; determine a second instantaneous direction ofthe second ink stroke at its later end; determining an angle between thefirst and second directions; where the determined angle exceeds athreshold angle, displaying the first ink stroke; and where thedetermined angle does not exceed the threshold angle, displaying thesecond ink stroke.

In some example, the facility provides a computer-readable medium havingcontents configured to cause a computing system to: receive informationabout a spatial movement by a user; on the basis of the receivedinformation, predict future spatial movement by the user; generate anink stroke that reflects both the spatial movement described by thereceived information and at least a portion of the predicted futurespatial movement; enforce against the generated ink stroke a limit thathas the effect of controlling the area of a portion of the ink strokecorresponding to the at least a portion of the predicted future spatialmovement; and cause the generated ink stroke, subject to the enforcementof the limit, to be displayed.

In some examples, the facility provides a processor-based device,comprising: a processor; and a memory having contents that cause theprocessor to: receive information about a spatial movement by a user; onthe basis of the received information, predict future spatial movementby the user; generate an ink stroke that reflects both the spatialmovement described by the received information and at least a portion ofthe predicted future spatial movement; enforce against the generated inkstroke a limit that has the effect of controlling the area of a portionof the ink stroke corresponding to the at least a portion of thepredicted future spatial movement; and cause the generated ink stroke,subject to the enforcement of the limit, to be displayed.

In some examples, the facility provides a method in a computing system,the method comprising: receiving information about a spatial movement bya user; on the basis of the received information, predicting futurespatial movement by the user; generating an ink stroke that reflectsboth the spatial movement described by the received information and atleast a portion of the predicted future spatial movement; enforcingagainst the generated ink stroke a limit that has the effect ofcontrolling the area of a portion of the ink stroke corresponding to theat least a portion of the predicted future spatial movement; and causingthe generated ink stroke, subject to the enforcement of the limit, to bedisplayed.

In some examples, the facility provides a computer-readable mediumstoring a data structure containing information about touch input touchpoints, the data structure comprising: for each of a plurality of touchpoints, an entry comprising: coordinates at which the touch pointoccurred; an improved time-related indication attributed to the touchpoint, the improved time-related indication constituting an aggregationon time-related indications originally attributed to the touch point andat least one contiguously-preceding touch point, the entries with theirimproved time-related indications being usable to predict future touchpoints with greater accuracy than is possible with the time-relatedindications originally attributed to the touchpoints.

It will be appreciated by those skilled in the art that theabove-described facility may be straightforwardly adapted or extended invarious ways. While the foregoing description makes reference toparticular embodiments, the scope of the invention is defined solely bythe claims that follow and the elements recited therein.

We claim:
 1. A processor-based device comprising: at least one computerprocessor; and a computer-readable storage medium comprisinginstructions for controlling the at least one computer processor to:receive information about a spatial movement by a user, the spatialmovement comprising user input activity by the user; on the basis of thereceived information, predict future spatial movement by the user;generate an ink stroke that reflects both the spatial movement describedby the received information and at least a portion of the predictedfuture spatial movement; enforce against the generated ink stroke alimit that has the effect of controlling a thickness of a portion of theink stroke, wherein the thickness of the ink stroke is based at least onthe predicted future spatial movement; and cause the generated inkstroke, subject to the enforcement of the limit, to be displayed,wherein an extent of the predicted future spatial movement that isdetermined by enforcement of the limit is a number of contact points ofthe predicted future spatial movement that are reflected in thegenerated ink stroke, wherein the limit that is enforced against thegenerated ink stroke determines the extent of the predicted futurespatial movement to be reflected in the generated ink stroke.
 2. Theapparatus of claim 1, wherein the user input activity includes one ormore of a handwriting movement and a drawing movement.
 3. The apparatusof claim 1, wherein the extent of the predicted future spatial movementthat is determined by the enforcement of the limit further includes adistance of the predicted future spatial movement that is reflected inthe generated ink stroke.
 4. The apparatus of claim 1, wherein the limitthat is enforced against the generated ink stroke limits a thickness ofa portion of the ink stroke reflecting the at least a portion of thepredicted future spatial movement to be no greater than a boundarythickness.
 5. The apparatus of claim 1, wherein the limit that isenforced against the generated ink stroke determines the extent of thepredicted future spatial movement to be reflected in the generated inkstroke in a way that omits portions of the predicted future spatialmovement that either (1) exceed a boundary thickness, or (2) arepredicted to occur later than a portion that exceeds the boundarythickness.
 6. A method comprising: receiving information about a spatialmovement by a user, the spatial movement comprising user input activityby the user; on the basis of the received information, predicting futurespatial movement by the user; generating an ink stroke that reflectsboth the spatial movement described by the received information and atleast a portion of the predicted future spatial movement; enforcingagainst the generated ink stroke a limit that has the effect ofcontrolling a thickness of a portion of the ink stroke, wherein thethickness of the ink stroke is based at least on the predicted futurespatial movement; and causing the generated ink stroke, subject to theenforcement of the limit, to be displayed, wherein an extent of thepredicted future spatial movement that is determined by enforcement ofthe limit is a number of contact points of the predicted future spatialmovement that are reflected in the generated ink stroke, wherein thelimit that is enforced against the generated ink stroke determines theextent of the predicted future spatial movement to be reflected in thegenerated ink stroke.
 7. The method of claim 6, wherein the user inputactivity includes one or more of a handwriting movement and a drawingmovement.
 8. The method of claim 6, wherein the extent of the predictedfuture spatial movement that is determined by the enforcement of thelimit further includes a distance of the predicted future spatialmovement that is reflected in the generated ink stroke.
 9. The method ofclaim 6, wherein the limit that is enforced against the generated inkstroke limits a thickness of a portion of the ink stroke reflecting theat least a portion of the predicted future spatial movement to be nogreater than a boundary thickness.
 10. The method of claim 6, whereinthe limit that is enforced against the generated ink stroke determinesthe extent of the predicted future spatial movement to be reflected inthe generated ink stroke in a way that omits portions of the predictedfuture spatial movement that either (1) exceed a boundary thickness, or(2) are predicted to occur later than a portion that exceeds theboundary thickness.